Model Waveform Accuracy Standards for Gravitational Wave Data Analysis 
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Model waveforms are used in gravitational wave data analysis to detect and then to measure 
the properties of a source by matching the model waveforms to the signal from a detector. This 
paper derives accuracy standards for model waveforms which are sufficient to ensure that these data 
analysis applications are capable of extracting the full scientific content of the data, but without 
demanding excessive accuracy that would place undue burdens on the model waveform simulation 
community. These accuracy standards are intended primarily for broad-band model waveforms 
produced by numerical simulations, but the standards are quite general and apply equally to such 
waveforms produced by analytical or hybrid analytical-numerical methods. 



I. INTRODUCTION 

The purpose of this paper is to derive standards for 
the accuracy of model waveforms sufficient to ensure that 
those waveforms are good enough for their intended uses 
in gravitational wave data analysis. This is a timely and 
important subject which has received relatively little at- 
tention in the scientific literature up to this point. Several 
gravitational wave detectors [l|, [3, Q have now achieved 
a high enough level of sensitivity that the first astro- 
physical observations are expected to occur within the 
next few years. The numerical relativity community has 
also matured to the point that several groups are now 
computing model gravitational waveforms for the inspi- 
ral and merger of black hole and neutron star binary sys- 
tems H S i, 0, S i, E [lip, [11 ■ Beyond the pioneer- 
ing work of Mark Miller 14 1 and Stephen Fairhurst , 
however, little effort has gone into thinking about the 
question of how accurate these model waveforms need to 
be. 

This paper contributes to this discussion by formulat- 
ing a set of accuracy standards for model waveforms, suf- 
ficient to ensure that those waveforms are able to fulfill 
the detection and parameter-measurement roles they will 
be required to play in gravitational wave data analysis. 
The standards presented here are designed to be optimal 
in the sense that waveforms of lesser accuracy would re- 
sult in some loss of scientific information from the data, 
while more accurate waveforms would merely increase the 
cost of computing the waveforms without increasing their 
scientific value in data analysis. Our discussion is done 
here at a fairly abstract level, with the intention that 
these accuracy standards should be applicable to model 
waveforms produced by approximate analytical methods 
(such as post-Newtonian expansions) as well as model 
waveforms produced by numerical simulations. 

Our discussion is divided into two parts: The first part, 
in Sec. |TT1 assumes that the calibration of the gravita- 
tional wave detector is perfect. That is, we assume that 
the response function used to convert the interferometer 
output to a gravitational wave signal is known exactly. 



In this ideal detector case, we present simple derivations 
for the needed accuracy of model waveforms for detec- 
tion and separately for parameter measurement purposes. 
The second part, in Sec. IIIIl evaluates the effects of cal- 
ibration error (i.e., the errors in the measurement of the 
response function) on the needed accuracy requirements 
for model waveforms. 

For simplicity, all of our discussion here will be based 
on the frequency-domain representations of gravitational 
waveforms h{f), defined as. 



Hf) 



(1) 



where h{t) is the time-domain representation of the wave- 
form.^ Since the frequency-domain representation of 
waveforms is somewhat less familiar to the numerical rel- 
ativity community, we include Figs. [T] and [3 to illustrate 
the frequency-domain amplitude Ah and phase '^h, de- 
fined as h{f) = yl/ie**'', of the waveform for a binary 
black-hole system composed of equal-mass non-spinning 
holes. The numerical part of this waveform was produced 
by the Caltech/CorncU numerical relativity group [Tl . 
and a post-Newtonian model waveform was stitched on 
for the lowest part of the frequency range [17] . The con- 
stants M and r (used as scale factors in these figures) are, 
respectively, the total mass and the luminosity distance 
of the binary system. For clarity of presentation, we 
have removed the linear in / part of $/i(/), which corre- 
sponds to shifting the origin of the time coordinate. We 
have also adjusted the constant part of the phase so that 
^hif) does not have a zero and can be graphed more con- 
veniently. These time and phase constants are kinematic 



^ We follow the convention of the LIGO Scientific Collabora- 
tion [l6l | (and the signal-processing community) by using the 
phase factor g-^Trz/t these Fourier transforms; most of the 
early gravitational wave literature and essentially all other com- 
putational physics literature use e^'^'-^'. This choice does not 
affect any of the subsequent equations in this paper. 
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FIG. 1: Amplitude Ah of tlie frequency-domain gravitational 
waveform for an equal-mass non-spinning binary black-hole 
system. Constants representing the total mass, M, and the 
distance, r, to the binary system have been introduced to 
make the graphed quantities dimensionless, independent of 
the mass of the source, and (asymptotically) independent of 
the observer's position; G is Newton's constant and c is the 
speed of light. 



parameters, which are not related to the internal dynam- 
ics of the waveforms. The resulting shown in Fig. [2] 
is not monotonic in /, and this might seem counterintu- 
itive at first. We note that the addition of the linear in / 
term, 27rio/, can make ^h{f) either monotonic increas- 
ing or decreasing, depending on the value of the time 
constant to. We also note that the illustrated in 
Fig. [2] is the phase of the Fourier transform of h{t), and 
consequently has no simple relationship with the phase 
of the time-domain waveform. 

While the accuracy standards derived here apply to 
any type of gravitational waveform, in practice we expect 
them to be most useful for broad-band waveforms such as 
those from compact binary systems. Narrow band gravi- 
tational wave signals, such as from rotating neutron stars, 
are expected to be analyzed using modified versions of the 
data analysis methods described here, i.e., using the J^- 
statistic matched filter or time-domain heterodyning . 
The accuracy-standard analysis presented here could eas- 
ily be extended to these cases [H, [l^l ■ However narrow- 
band continuous-wave sources have very simple and ro- 
bust phcnomcnological waveforms, and so the question 
of modeling error does not arise in the same way it does 
for systems with very complex waveforms like compact 
binary systems. 

II. IDEAL DETECTOR CASE 
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FIG. 2: Phase $h (measured in radians) of the frequency- 
domain gravitational waveform for an equal-mass non- 
spinning binary black-hole system. The constant M, repre- 
senting the total mass of the binary system, has been intro- 
duced to express the frequency in dimensionless units, and to 
make the graphed quanties independent of the mass of the 
source; G is Newton's constant and c is the speed of light. 



We split the discussion of the ideal detector case into 
three parts. First we present in Sec. Ill Al a simple deriva- 
tion of the accuracy of model waveforms needed to en- 
sure no loss of scientific information when the waveform 
is used to measure the physical properties of a gravita- 
tional wave signal. Second we present in Sec. Ill Bl a sim- 
ple condition on the accuracy of model waveforms needed 
to ensure a prescribed level of detection efficiency. These 
accuracy requirements in Sees. Ill Al and III Bl are optimal 
in the sense that any model waveform violating them 
would decrease the scientific effectiveness of the detec- 
tor. Unfortunately these conditions depend on the de- 
tector's noise curve in a complicated way, so enforcing 
them is somewhat complicated. Therefore we present in 
Sec. Ill Cl a set of simpler conditions that are nevertheless 
sufficient to guarantee that the optimal conditions are 
satisfied. While these sufficient conditions are somewhat 
stronger than needed, they are much simpler to apply; so 
we hope they will be easier for the waveform simulation 
community to adopt and use on a regular basis. 



A. Accuracy Requirements for Measurement 

The question we wish to address here is, how small 
must the difference between two waveforms be to ensure 
that measurements with a particular detector are unable 
to distinguish them? This condition determines how ac- 
curate a model waveform hm must be to make it indistin- 
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guishable from the exact physical waveform he through 
any measurement with a particular detector. 

For simplicity, we will perform our analysis in terms 
of the frequency-domain representation of the waveforms 
heif) and hm{f). Consider the one parameter family of 
waveforms, 



MA,/) - {l-\)K{f) + \K 
= heif) + XSh{f), 



if), 



(2) 



that interpolates between and h„i as A varies between 
and 1. We now ask the related question, how accurately 
can a particular gravitational wave detector measure this 
parameter A? There exists a well developed theory of 
parameter measurement accuracy for gravitational wave 
data analysis, discussed for example in Finn [21j, Finn 
and Chernoff [12] and Cutler and Flanagan [23 1. We 
construct the noise- weighted inner product {he\hm) given 

by 



{he\hr, 



Snif) 



df, (3) 



where Snif) is the one-sided power spectral density of 
the detector strain noise. In defining this inner product, 
we use the fact that the Fourier transform of the real 
gravitational-wave strain h{t) satisfies h{f) = h*{—f), 
thus allowing us to define the inner product as an integral 
over positive frequencies only. 

The variance cr| of measurements of the parameter A 
is given by the expression 



dh 
dX 



dh 

— ) = {Sh\Sh), 



(4) 



using Eq. (3.20) of Ref. or Eq. (2.8) of Ref. [H. 

If the standard deviation ax were greater than one (the 
parametric distance between h^ and hm), then the two 
waveforms would be indistinguishable through any mea- 
surement with the given detector. Thus the condition, 
(Ta > 1, or equivalently. 



{6h\6h) < 1, 



(5) 



ensures that the two waveforms are indistinguishable.^ If 
we consider he to be the exact waveform, and 6h to be the 
difference between the model and the exact waveforms, 
then the model waveform will be indistinguishable from 
the exact if and only if ((5/i|(Sft.) < 1. Our derivation of this 
condition is based on the simple one-parameter family 
of waveforms defined in Eq. however, this argument 
applies to every possible model waveform error Sh. So the 
argument and resulting condition are completely general: 



^ This inequality, obtained through a different argument, was pre- 
sented by Stephen Fairhurst in a talk at the "Interplay between 
Numerical Relativity and Data Analysis" Miniworkshop, at the 
KITP, UCSB in January 2008. 



any acceptable waveform model must lie within a ball of 
unit radius centered on the exact waveform. 

We can re-express this limit, Eq. ([5]), as a simple condi- 
tion on the needed phase and amplitude accuracies of the 
model waveforms. Let Xe and denote real functions 
representing the logarithmic amplitude and phase of the 
exact waveform: he = 6-^"+'*''. The model waveform 
may differ from the exact in both amplitude and phase: 
he+5h = hee^^+'^'^ or to first order 5h = {5x+iS<i>)he. It 
is also useful to introduce the normalized waveform he = 
hep~^, which satisfies {he\he) = 1, where = {he\he). 
Using these quantities we can express the inner product 
{dh\Sh) in the following way 



{Sh\Sh) = p"^ ({Sx + iS<S>) he iSx + iS^)h 



(6) 



where the signal-weighted averages of the logarithmic 
amplitude and phase errors are defined by, 



Sx^ = {Sxhe\Sxhe), 

= {d^he\S'S>he). 



(7) 

(8) 



We can use these definitions to express Eq. © as a simple 
limit on the signal-weighted averages of the logarithmic 
amplitude and phase errors: 



2 2 1 

6x +S<P < 

P 



(9) 



Equation ([5]) or equivalently Eq. ^ are the basic re- 
quirements on model waveforms for measurement pur- 
poses. These requirements are optimal in the sense that 
waveforms more accurate than this would not improve 
scientific measurements, while less accurate waveforms 
would degrade some measurements. 



B. Accuracy Requirements for Detection 

The signal-to-noise ratio for the detection of a signal 
he using an optimal filter constructed from the model 
waveform hm is given by 



(he\hr, 



{he\K 



(10) 



cf. Eq. (A24) of Ref. [2a|. The question we wish to ad- 
dress here is, how accurate must the model waveform h^n 
be to ensure no significant loss in the efficiency of detect- 
ing the signal /le? Detections are made when a signal is 
observed that exceeds a predetermined threshold signal- 
to-noise ratio. So errors in evaluating the signal-to-noise 
ratio will decrease the detection efficiency. We must de- 
termine therefore how errors in the model waveform /i^ 
degrade the measured signal-to-noise ratio, Pm, relative 
to the optimal signal-to-noise ratio p — {he\he)^^'^. We 
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introduce a parameter e, referred to as the mismatch in 
the gravitational- wave data-analysis literature [2J|] , that 
measures this signal-to-noise reduction: 



(l-e)p. 



(11) 



To determine how model waveform errors 6h affect e, 
we write the model waveform as hm = + 5h, and re- 
write Eq. (jlip in terms of the definitions of p and pm- 



{h,\h, + Shy 
{he + 6h\hf, + 5h) 



(1 



-{K\he 



(12) 



This equation can be simplified by decomposing 5h into 
two parts: 5h\\ = he{dh\he) and dh± ^ 6h — 6h\\. This 
(5/i|| is proportional to h^, while Sh± is orthogonal to it 
in the sense that {Sh±\he) = 0. Using these expressions 
it is straightforward to derive the following relationship 
between the mismatch e and the model waveform error: 



(ShjJShj 

2{he\he\ 



(13) 



We have kept only the lowest-order terms in dh (which 
we assume to be small) in this expression. Equation (fT^]) 
shows that the mismatch e is proportional to the square 
of the distance between two waveforms, as measured by 
the noise- weighted inner product. 

To ensure a high level of detection efficiency while us- 
ing an optimal filter based on /im, we must ensure that 
the model waveform error 6h is small enough to prevent 
e from becoming unacceptably large. Let Cmax be the 
maximum mismatch compatible with our target detec- 
tion efficiency. In that case Eq. places the following 
limit on the model waveform error: 



{6h^\Sh^) < 2p2 



(14) 



When real searches are conducted to detect signals by 
matching to a model waveform, the measured signal- 
to-noise ratio Pm is maximized over different time and 
phase offsets of the model waveform. Thus the part of 
the model waveform phase error linear in / (the part that 
depends on the time and phase offsets) is not relevant for 
detection. Strictly speaking then, the inner product that 
appears in Eq. should be interpreted as the "match" 
inner product, defined as the Eq. ^ inner product opti- 
mized over these time and phase offsets 24]. 

Equation with {Sh±\5h±) interpreted as the 

match inner product, gives the optimal condition on the 
allowed model waveform error for detection purposes. 
Unfortunately it is not generally possible to determine 
what the orthogonal part of the waveform error dh± ac- 
tually is without knowing the exact waveform, so a sim- 
pler, easier to evaluate limit is desirable. We can obtain 
such a condition by noting that {Sh\6h) > {Sh±\Sh±) 
(where the inner product on the left can be the standard 
noise- weighted inner product); so a sufficient condition 
that ensures the target detection efficiency is 



We note that this condition is considerably weaker (de- 
pending on the values of p and emax) than the limit pre- 
sented in Eq. ^ to ensure no loss of accuracy in param- 
eter measurements. We can also transform this limit, 
Eq. (jisp . into a simple expression for the needed accu- 
racy of the amplitude and phase of model waveforms, 
in analogy with those found for measurement accuracy 
in Sec. Ill Al As before we express the model waveform 
error in terms of logarithmic amplitude and phase er- 
rors: Sh = {6x + iS^)he- Substituting this into Eq. 
we arrive at a simple expression for the limit on the 
signal-weighted averages of the logarithmic amplitude 
and phase errors required for detection: 



6x < 2e„ 



(16) 



The value of the maximum mismatch Cmax that ap- 
pears in Eqs. ^5]) and (fT6)l must be set by the de- 
mands of the particular data-analysis application. Set- 
ting e,nax = 0.035 in a search using a single model- 
waveform template, for example, would result in a re- 
duction in detection rate (for sources that are uniformly 
distributed in space) of 1 — (1 — Cmax)'^ ~ 0.10, a tar- 
get that is often adopted in LIGO searches for compact 
binary inspirals [H, [gi, [13, ill . 

Real gravitational-wave searches are more compli- 
cated, and making the appropriate choice of Emax is more 
subtle. Real searches are generally performed by match- 
ing discrete template banks of model waveforms with the 
data. Let hb represent one of the (normalized) waveforms 
in the discrete template bank; let hm be a (normalized) 
model waveform whose (appropriately defined) distance 
from hi, is the maximum for the given template bank; 
and let h^ denote the (normalized) exact waveform whose 
distance is closest to hfn, see Fig. |3l The model wave- 
form hm having the same physical parameters as he may 
not be identical to hm, since there may be a component 
of the waveform error tangent to the model-waveform 
submanifold. The quantity FF = (he\hm) = 1 — epF 
is often referred to as the fitting factor [23|; MM — 
{hfa\hb) = 1 — cmm is the minimal match [23 |: and we 
refer to EFF — {he\hb) = 1 — eeff as the "effective fit- 
ting factor." The goal is to have any physical waveform 
match some model waveform in the template bank with 
a mismatch that is no greater than the chosen eeff (for 
example eEPF = 0.035). The value of epF is completely 
determined by the chosen target ceff, and the param- 
eter eMM which describes the spacing of models in the 
discrete template bank. Since hm is the best-fit model 
waveform for the exact waveform he, it follows that the 
relative waveform vector he — hm will be orthogonal to 
any vector tangent to the model-waveform submanifold 
at hm', thus = {he — hm\hb — hm) in the limit that /if, 
and he are infinitesimally close to hm. Writing out this 
orthogonality condition in terms of the mismatch param- 
eters defined above gives 



{5h\5h) < 2p2 



(15) 



CFF = CEFF — fMM, 



(17) 
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max 




FIG. 3: Solid line illustrates the model-waveform submani- 
fold, with particular members of a discrete template bank hi, 
and hf,i . The model waveform hm has the maximum mismatch 
Emm with the template bank waveform ht- The closest exact 
waveform he has mismatch epp with hm and total effective 
mismatch eepf = emm + epp with hi,- The model waveform 
hm having the same physical parameters as he may differ from 
hm due to modeling errors, and its mismatch tmax will always 
exceed epp: e^ax > epp. 



a kind of Pythagorean theorem for model- waveform mis- 
matches. (Recall from Eq. [13| that the mismatch e mea- 
sures the square of the distance between nearby wave- 
forms.) The template banks used for compact binary 
searches in initial LIGO are constructed with cmm = 0.03 
(25I [26I [28j . implying that the needed accuracy of the 
model waveforms is epp — 0.005 when eppp = 0.035. 
Since hm is the closest model waveform to /ig, it follows 
that the mismatch between hg and hm (the model wave- 
form with the same physical parameters as he) will al- 
ways be greater than the mismatch between h^ and hm. 
So it is sufficient to require the maximum mismatch pa- 
rameter eniax, that appears in Eqs. ^T5\i and (fTB)) . to have 
the maximum value allowed for epp- Thus emax should 
have the value 0.005 for the current LIGO searches. It 
will be appropriate to revisit the issue of optimizing the 
values of emm and epp, including the cost of producing 
the model waveforms versus the cost of continually fil- 
tering with more populous template banks, when fully 
numerical template banks are constructed in the future. 



C. Sufficient Conditions 

The model waveform accuracy requirements for mea- 
surement, Eq. and detection, Eq. p^ . are optimal 
in the sense that a model waveform failing to meet these 
standards will cause a loss of scientific information. Con- 
versely, a model waveform having smaller errors than re- 
quired will result in no added scientific value. Unfortu- 
nately these accuracy requirements are somewhat com- 
plicated to evaluate, since they place limits on the signal- 
weighted amplitude and phase errors, Sx and 6^. These 
weighted averages must be computed with the frequency- 
domain waveform hm (/) and the detector noise spectrum 
Sn{f)- While model waveforms often scale in a trivial 
way with the total mass of the gravitational wave source, 
the detector noise spectrum does not. So the model wave- 



form errors must be evaluated separately for each mass, 
and for each detector noise spectrum. The purpose of 
this section is to construct a set of simpler to apply ac- 
curacy requirements that are nevertheless sufficient to 
guarantee that the optimal conditions Eqs. ([9]) and (flB]) 
are satisfied. While these sufficient conditions are stricter 
than needed in many cases, we hope that their ease of use 
will allow the waveform simulation community to employ 
them on a regular basis. In this section we present three 
different sufficient conditions that can be applied to the 
frequency-domain representations of the waveforms, and 
one condition that can be applied directly to the time- 
domain waveforms. 

The simplest sufficient conditions can be obtained by 
noting that max|(5x| > Sx and max|(5$| > S^, as a con- 
sequence of the definitions of the signal-weighted wave- 
form errors in Eqs. ([7]) and ([8]). The following are there- 
fore sufficient conditions which ensure the optimal wave- 
form standard Eq. ^ is satisfied for measurement, 

(max|(5x|)' + (max|(5$|)' < \, (18) 

and Eq. is satisfied for detection 

(max 1 5x1)' + (max 1 ,5$ I)' < 2e„,ax. (19) 

We note that the maxima max \ Sx\ and max |(5$| in these 
limits refer to the frequency-domain waveform errors. 
These requirements are significantly simpler to apply 
than the optimal waveform standards because they elim- 
inate the detector noise spectrum from the calculation, 
except for its contribution to the signal-to-noise ratio p. 
While simple to evaluate however, these limits on the 
maxima are stronger than necessary, especially if the am- 
plitude or phase errors are sharply peaked in a narrow 
range of frequencies or the maximum occurs at a fre- 
quency where the amplitude of the wave is very small. 

A second, sometimes less demanding sufficient condi- 
tion on the accuracy of model waveforms can be obtained 
by noting that {Sh\Sh) can be written as. 



{Sh\5h) = {SA\SA) + {AJ<S>\AJ<i>), 



< 



max \ 6A\ 



max |v4e(5<i>| 



(20) 



where A^ = 6 A = A^Sx, and the average detector 
noise n is defined as, 



1 



df 



SM) 



(111). 



(21) 



We can use Eq. ([20]) to convert Eqs. ^ and (fT5| into 
alternate sufficient conditions for model waveform accu- 
racy by introducing a quantity C: 



C 



_ pn 



AeifcY 



(22) 



In this expression is a frequency that characterizes the 
particular waveform. For the equal mass binary black- 
hole waveforms shown in Fig.[T]for example, a convenient 
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choice might be /c = 0.08/M which occurs near the point 
in the spectrum where the two black holes merge. This 
quantity C is the ratio of the standard signal-to-noise 
measure p, and the non-standard measure Ae{fc)/n. Us- 
ing the definition of C and Eq. (|20p . we can convert 
Eq. ([5]) into a simple sufficient condition on the model 
waveform accuracy for measurement, 



max \ 6A\ 


2 


[ Mfc) \ 





max |^e^$| 



'C 
P 



(23) 



Aeifc) 

and Eq. (jlSp into a sufficient condition for detection pur- 
poses, 



max \ 6A\ 


1 


'max Ae(5<i> ' 


2 


[ Mfc) \ 


+ 


i ^e(/c) \ 





(24) 



We note that the errors bounded in Eqs. (fTS]) and are 
the logarithmic amplitude and phase errors, while those 
in Eqs. and ([M)) are errors relative to the fixed char- 
acteristic amplitude ^e(/c). The limits in Eqs. (|23|) and 
([M)) may therefore be more useful, because they avoid 
the unnecessarily restrictive conditions on max|(5x| and 
max I (5$ I when those maxima occur at frequencies where 
the amplitude of the waveform is small. 

The requirements in Eqs. (|23p and ([M]) have the dis- 
advantage, however, of involving the quantity C which 
depends on the details of the waveform and the detector 
noise spectrum. Nevertheless, this quantity can easily 
be evaluated for a given class of waveforms and a given 
detector noise spectrum. For example. Fig. 3] illustrates 
C for the case of non-spinning equal-mass binary black- 
hole waveforms with /c ~ 0.08/M using the Initial LIGO 
noise curve :30] with a 40 Hz low frequency cutoff [1], and 
the Advanced LIGO noise curve [3l| with a 10 Hz low fre- 
quency cutoff. The scale factor Mq used in this figure is 
the mass of the sun, Mq = 2.0 x 10^^ g, which in geomet- 
rical time units is Mq = 4.9 x 10~^ s. This curve shows 
that C > 0.6 for the mass range of non-spinning binary 
black-hole systems of p rimary relevance to Initial LIGO, 
5 < M/Mq < 100 [35]. Thus for Initial LIGO it_is suffi- 
cient to enforce Eqs. (pS]) and ([M]) for the case C « 0.6. 
The mass range for non-spinning binary black-hole sys- 
tems of primary relevance for Advanced LIGO extends 
to, 5 < M/Mq < 400, because the low frequency cutoff 
is 10 Hz instead of 40 Hz. For Advanced LIGO then, it 
is appropriate to use the minimum value C ~ 0.06 when 
enforcing Eqs. ^ and 

A third sufficient condition can be obtained by noting 
that. 



{5h\Sh) = 4 



\Shif)M 



< 



SM) 

minSnif) 



where ||(5/i(/)|| is the norm of Sh{f), defined as 

/>OC 

\\Sh{fW^2 \5hU)\'df. 
Jo 



(25) 



(26) 
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FIG. 4: Solid curves illustrate C and C, as defined in Eqs. (|22|) 
and H27|) . as functions of the total mass for non-spinning 
equal-mass binary black-hole waveforms and the initial LIGO 
noise spectrum. Dashed curves give the same quantities com- 
puted with the Advanced LIGO noise curve. 



The inequality in Eq. (j25p can be converted to sufficient 
conditions for the optimal waveform requirements by in- 
troducing the quantity C, 



2 _ p^minS'„(/) 



2\\he{fW 



(27) 



the ratio of the standard signal-to-noise measure p to an- 
other non-standard measure ||^e(/)||/ •\/niin5„(/). Us- 
ing this definition it is straightforward to convert Eq. (|25l) 
into sufficient conditions for the optimal error require- 
ments of Eq. ([5]) for measurement. 



WheifW 

and Eq. (fT5|) for detection 

WheifW 



< 



(28) 



(29) 



As with the previous requirements, these can be written 
in terms of the amplitude and phase of the frequency- 
domain waveform: for measurement, 



UeifW 

and for detection 

\\SA{fW + \\AJ^fW 

UeifW 



< 



^ 26niaxC* . 



(30) 



(31) 
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These requirements depend only on the average value 
of the model waveform error and so they are 

considerably weaker than (and in this sense are superior 
to) the conditions in Eqs. (|23p and (|24p . Their biggest 
drawback is their dependence on the waveform and noise 
spectrum through the quantity C . It is straightforward 
to show that C < 1 following an argument similar to that 
which led to Eq. (|25p. However the exact value of C will 
depend on the details of the model waveform, including 
in particular the mass of the gravitational wave source. 
But C can easily be evaluated for a given class of model 
waveforms and a given detector noise spectrum. For ex- 
ample, Fig.|4]shows a graph of C as a function of the mass 
for non-spinning equal-mass binary black-hole waveforms 
(evaluated with the Initial and the Advanced LIGO noise 
curves). This figure shows that taking minC ~ 0.02 in 
Eqs. ((28| and ((29l) is sufficient for the binary black- hole 
mass range 5 < M/Mq < 400 of primary relevance to 
Advanced LIGO, while taking minC « 0.04 is sufficient 
for the mass range 5 < M/Mq < 100 of primary rele- 
vance to Initial LIG0~[3^. We note that the functions 
C and C illustrated in Fig. [5] apply, strictly speaking, 
only to the waveform illustrated in Figs. [T] and O A 
more comprehensive investigation will be required to de- 
termine how sensitive these functions are to other model- 
waveform parameters (like the mass ratio and the spins 
of the black holes) and to other effects (like the frequency 
range of a given model waveform). 

Our discussion up to this point has focused on the 
development of accuracy standards for the frequency- 
domain representations of model waveforms. This ap- 
proach simplifies the analysis, and is natural from the 
LIGO data analysis perspective. However, model wave- 
forms must often be computed in the time domain, e.g. 
by numerical relativity simulations. While time-domain 
waveforms can be converted to the frequency domain, do- 
ing so is somewhat delicate and requires making judicious 
choices in performing the needed Fourier transforms — 
like choosing appropriate windowing functions. Having 
time-domain versions of the needed accuracy standards 
would therefore make it much easier for the waveform 
simulation community to monitor and deliver waveforms 
of the needed accuracy. The third set of sufficient wave- 
form accuracy requirements, Eqs. (|28|) and ((29)) . can eas- 
ily be converted to conditions on the time-domain wave- 
forms. This can be done because the norm of a 
time-domain waveform is identical to the norm of its 
frequency-domain counterpart, e.g. ||^ft,(t)|| — \\6h{f)\\, 
by Parseval's theorem. Thus, the following are the corre- 
sponding time-domain waveform accuracy standards for 
measurement. 



Wheim p' 



and for detection 



Wheim 



< y2e 

max 

c. 



(32) 



(33) 



It is not generally possible to decompose the real time- 
domain waveform unambiguously into amplitude and 
phase. Therefore it is not possible to construct mean- 
ingful time-domain analogs of the amplitude and phase 
limits given in Eqs. ((30|) and (|3T|). 



III. INCLUDING CALIBRATION ERRORS 

In this section we consider the implications of having 
a detector response function that is not known with ab- 
solute precision. First we establish a little notation. Let 
v{f) denote the direct electronic output of the detector, 
and R{f) the response function that converts the raw 
output v{f) into the inferred gravitational wave signal 
Hf): 



h{f) = R{f)v{f). 



(34) 



Let us assume that the measured response function R{f) 
differs from the correct exact response function Re{f) 
by SR{f) — R{f) — Reif)- This error in the response 
function will affect measurements in two ways. First, the 
response of the instrument to a gravitational wave signal 
/le will produce an electronic output v^- Using the mea- 
sured response function R, the signal will be interpreted 
as the waveform h = Rve = /lee''-^^''""^*^ , where the loga- 
rithmic response function amplitude Sxr and phase S^r 
errors are defined by 



R^Re + SR = i?ee'^'^«+'''*«. 
Thus there will be a waveform error, 

ShR = /jee*>^«+^**« - /le, 



(35) 



(36) 



caused by calibration errors in the instrument. The sec- 
ond effect of calibration error on measurements made 
with the instrument will be errors in our knowledge of 
the characteristics of the noise in the detector. In par- 
ticular the estimated power spectral density of the noise 
Sn will differ from the exact Se due to the calibration 
error SR. The estimated power spectral density Sn will 
be related to Se by 



Snif)^S,if)e 



2<5xf 



(37) 



The idea now is to evaluate the effects of errors in 
the model waveform, h,n ~ ft.ec'^'^""''"'*'" , plus the ef- 
fects of errors in the detector response function R = 
i?ee''-^"+'**", on the signal-to-noise ratio of a detected 
gravitational wave signal: 



(he + ShR\hm! 



(38) 



where the inner product is evaluated with respect to the 
estimated power spectral noise density S'„(/) of Eq. ([57)1 . 
The needed calculation is quite long, so we provide a few 
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intermediate steps. Keeping terms through second order 
in the two types of errors, we find: 

{he + 5hri\hm) ^ + p^{{5xm - 6xR)he\he) 

+ y ((^Xm - SxR)he\{5Xm " 5xR)he) 
-Y((^*m - 5^R)k\{5^m - S^R)he), (39) 

{h„i\h,ny^''^ = - - -{{SXm - SxR)he\he) 
P P 

{{^Xni - 5XR)he\{5Xm ~ ^XR^e) 

P 

+ ^{{SXm-SxR)he\kf. (40) 

2p 

Combining these using Eq. psp gives an expression for 
the effects of model and cafibration errors on the mea- 
sured signal-to- noise ratio pm-^ 

Pm = P - ^{{SXm - 5xR)he\{SXni - SxR fhe) 



ratio: 



+ ^{{SXm~SxR)k\h,f. 



(41) 



It is illuminating to write this expression in the form, 

Pm = p - -^{{5hra - ShB,)±\{Shjn - (5/i_r)±), (42) 
2p 



Pm > P - i^^^n - ShB]Shm - Shn) , 

2p 



v/ {6hfn\Sh„i) + {5hR\Shi 



(44) 



To aid our understanding of this expression, it is useful 
to define the ratio of the model waveform error to the 
response function error, rj: 



which allows us to re-write Eq. (|44|) as 



Pm > P- 7r{^ + ri?{5hR\5hR) 
2p 



(45) 



(46) 



If rj becomes too small, then the error in the measured 
signal-to-noise ratio pm is dominated by calibration er- 
rors, and further reductions in the model waveform error 
have little effect on our ability to make measurements 
or detections. The idea then is to place a limit on 
which ensures the model waveform is only as accurate as 
it needs to be to achieve the ideal-detector accuracy stan- 
dards of Secini It is appropriate therefore to require that 
•q be no smaller than some minimum cutoff: rj > rymin- 
In other words, the model waveform error need never be 
made smaller than 



(47) 



where 

{Shm - Shii)± = 6hm - Shu - K{6hm - 6hR\he). (43) 

The dependence of the measured signal-to-noise ratio pm 
on the waveform errors, Shm and ShR, can be under- 
stood as follows: If (hypothetically) the modeling er- 
rors were identical to the calibration errors, the mea- 
sured signal and template would still be identical, so the 
measured matched-filtering signal-to-noise ratio would be 
unchanged. If (again hypothetically) the net waveform 
error, 6h„i ~ SHr, were proportional to the exact wave- 
form, he , the measured signal-to-noise ratio pm would be 
unchanged because such errors merely re-scale the tem- 
plate, which has no effect on p,„ . Thus only net waveform 
errors that are orthogonal to h^, in the sense of Eq. pS)) . 
actually contribute to losses in p^- 

We can use this basic expression, Eq. (|^ , for the com- 
bined effects of model waveform error and calibration er- 
ror to derive a useful inequality on the signal-to-noise 



^ A special case of this expression for the signal-to-noise ratio 
including the first-order calibration-error terms was obtained 
previously by Bruce Allen [33ll . and an expression including 
the second-order calibration error terms (and some of the first- 
order model-error terms) was obtained previously by Sukanta 
Bose [H. 



This inequality can also be expressed as a condition on 
the signal-weighted amplitude and phase errors defined 
in Sec. [m 



SXr. 



7 m in 



(5$; 



(48) 



These lower limits, Eqs. (|T7)) or on the model wave- 
form error must be imposed simultaneously with the ap- 
propriate upper limits derived in Sec.|TT]for measurement, 
Eq. (I9|), or detection, Eq. (fT6|) . Calibration error will in- 
terfere with the operation of a detector whenever it is 
impossible to satisfy the ideal-detector accuracy require- 
ments of Sec. In] and the calibration-error lower limits 
simultaneously. 

To determine the appropriate value for Tymin, we note 
from Eq. (j46|) that a model waveform having the minimal 



error r/ 



Vn 



could have an effect on the measured 



signal-to-noise ratio that is as large as. 



> 



1 

Yp 



{l+Vnunf{ShR,\ShR) 



(49) 



Setting ?7min = 1 corresponds to one natural choice: mak- 
ing the model waveform errors greater than or equal to 
the calibration errors. However, we see from Eq. ((49|) 
that the signal-to-noise ratio may be degraded by up to 
four times the effect of calibration error alone in this case. 
So this obvious choice for Tymin is probably too large. 
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Given the relatively low cost of producing improved 
model waveforms (compared to the cost of improving the 
hardware needed to reduce calibration errors), it makes 
sense to adopt a stricter standard for r]riim- Another nat- 
ural choice is to require that Tymin be small enough to 
ensure that the most accurate model waveforms have no 
larger effect on the signal-to-noise ratio than calibration 
errors alone. From Eq. (|49p we see that this requires 
(l + J?!!!!!!)^ < 2 or equivalently rymin < 0.4. Reducing rymi„ 
below this value has little effect on the signal-to-noise ra- 
tio; while quickly increasing the computational cost of the 
most accurate model waveforms. So this choice should be 
close to optimal. 

The most recent publicly available calibration data 
from Initial LIGO (S4), see Figs. 23 and 24 of Ref. [H, 
has the following limits on the frequency-domain calibra- 
tion error: 0.03 < x/Sxr + 6^% < 0.09 for the LI detec- 
tor and 0.06 < ^/6x^^+W^ < 0.12 for the HI detector. 
Therefore the appropriate minimum error requirement, 
including the effects of calibration errors from Eq. 
for Initial LIGO is^ 



Waveform Error 


Equation 


Measurement 


Detection 


Diagnostic 


Numbers 


Requirement 


Requirement 




El [16] 


l/V2p 


^ tmax 


max 


[mill] 


l/V2p 


^max 


max|Ae(5$|/yle(/c) 


[231 [21] 


C/V2p 


\/ ^max C 


\\A^5^f)\\/\\A^{f)\\ 


[3S113I] 


C/V2p 


yj ^max C 


\mt)\\/\\h4t)\\ 


[31 [33] 


C/p 


V^^max C 



TABLE I: Summary of model waveform accuracy require- 
ments for various waveform error diagnostics for measurement 
purposes (column three) and for detection purposes (column 
four) . 



(which is below any reasonable statistical threshold for 
detection) before the right side of Eq. ([5T|) exceeds the 
detection limit emax — 0.005. Thus, the current level of 
LIGO calibration errors are never likely to influence the 
waveform accuracy requirements established in Sec. Ill Bl 
for detection. 



f?min V(niin|(5xfl|)^ + (min |(5$7j |) ^ 
0.012. (50) 



Model waveform errors smaller than this limit will always 
be dominated by calibration errors. 

The magnitude of the calibration error in Initial 
LIGO is small enough that the calibration requirement, 
Eq. (|50[) . is consistent with our basic measurement re- 
quirements, Eq. © or for all but the very strongest 
sources: p 



> 80. Therefore the presence of calibration er- 
ror will not affect the ideal-detector waveform accuracy 
standards for LIGO measurements, unless an extremely 
strong source is detected. This is not to say that the 
presence of calibration error will have no effect on the 
accuracy of measurements for weaker sources; but the 
question of exactly how large those calibration error ef- 
fects are in that case must be decided by a somewhat 
more detailed analysis than the one presented here. 

The lower limit on model waveform error that arises 
from the presence of calibration error is always consis- 
tent with the condition on the waveform error needed for 
detection, Eq. (fTB]) . From Eq. (|49| , the fractional change 
in the signal-to-noise ratio caused by calibration error is 



< (1 + ^lin) 



2 {Shii\Shij) 



2p2 



(51) 



For Initial LIGO {ShR\ShR) < 0.014 (from the calibra- 
tion error measurements quoted above) thus the signal- 
to-noisc ratio p would have to be smaller than about 1.7 



* Although the calibration of the final data from Initial LIGO (S5) 
will be different from that of S4, the accuracy of the calibration 
is expected to be similar. 



IV. DISCUSSION 

In this paper we have developed a set of accuracy stan- 
dards for model gravitational waveforms. These stan- 
dards are designed to ensure that model waveforms are 
accurate enough to support the parameter measurement 
and detection needs of the gravitational wave data analy- 
sis community — without compromising the scientific con- 
tent of the data, and without placing needless demands 
for accuracy on the waveform modeling community. In 
Sec. |TT| we developed an optimal requirement for mea- 
surement purposes in Eq. ^ and for detection purposes 
in Eq. pB]) . These optimal standards place limits on the 
signal averaged amplitude and phase errors, 6x and (5$ 
respectively, as defined in Eqs. ([7]) and ([8]). The first row 
of Table [Tj summarizes these accuracy standards (assum- 
ing the amplitude and phase errors to be comparable) : p 
represents the standard signal-to-noise ratio of the wave- 
form, and Cmax represents the maximum signal-to-noise 
mismatch tolerated by a given detection procedure. 

Also listed in Table |I] are summaries of several suffi- 
cient conditions on the waveform accuracy developed in 
Sec. [Irel and described in detail in Eqs. 
([m, ([30]), ([31]), ([32]), and ([33]). The table entries for 
phase errors assume that the amplitude and phase errors 
are comparable. These sufficient conditions are some- 
what stronger than needed, but if satisfied they ensure 
the optimal requirements are satisfied as well. They are 
much simpler to apply. The quantities C and C which ap- 
pear in some of these conditions, defined in Eqs. ([^^ and 
([^T]) . compare different signal-to- noise measures of the 
waveforms. These quantities, which are waveform and 
detector noise dependent, are illustrated for non-spinning 
equal-mass binary black- hole waveforms in Figs. [Hand [5] 
for the LIGO and LISA detectors, respectively. 
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FIG. 5; Curves illustrate C and C, as defined in Eqs. (|22p and 
(|27[1 . as functions of the total mass for non-spinning equal- 
mass binary black-hole waveforms using the Barack and Cut- 
ler [36l ] approximate LISA noise spectrum. 



To apply these waveform accuracy standards to a par- 
ticular detector, we must know the values of the param- 
eters that appear in the requirements summarized in Ta- 
ble HI In particular we need to know maxp, emax, minC 
and min C for that detector. The maximum signal-to- 
noise ratio, max p, expected for Advanced LIGO is rather 
difficult to estimate, since the numbers and distribution 
of the relevant sources are not known yet. Here we need 
an estimate for max p only to compute the appropriate 
Advanced LIGO values of the requirements in Table [H 
so we take a rather simplistic approach: The threshold 
signal-to-noise ratio for detecting compact binary inspi- 
rals currently used by Initial LIGO is about p « 9 (for S4, 
the most recent data published) 28] . Advanced LIGO is 
expected to be about ten (or perhaps as much as fif- 
teen) times more sensitive than Initial LIGO. Therefore, 
if no binary black-hole system is observed in the Ini- 
tial LIGO (S5) data, then it is likely that the maximum 
signal-to-noise ratio for such events in the first year or 
two of Advanced LIGO observations will be no larger 
than about maxp « 100. (This estimate might need 
to be increased or decreased by about 50% depending 
on the final sensitivity improvement of Advanced LIGO, 
and the final threshold adopted for detections in the S5 
data; this final threshold will depend on the number of 
non-Gaussian artefacts found in the data.) Of course, if a 
binary black- hole signal is detected by Initial LIGO, then 
the expectation would be that a similar signal with ten to 
fifteen times that signal-to-noise ratio will be detected by 
Advanced LIGO. If Advanced LIGO template banks are 
constructed in the same way as those for Initial LIGO, 
then Cmax = 0.005 is the appropriate mismatch tolerance 
for Advanced LIGO as well. We also need estimates of 
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0.007 


0.07 
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0.007 


0.07 
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0.0004 


0.004 
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[3S113I] 


0.00014 
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0.0002 
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TABLE II: Summary of model waveform accuracy require- 
ments for the Advanced LIGO detector using various wave- 
form error diagnostics for measurement purposes (column 
three) and for detection purposes (column four). 



Waveform Error 


Equation 


Measurement 


Detection 


Diagnostic 


Numbers 


Requirement 


Requirement 
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2 • 10"* 


0.07 
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[18l[19] 
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TABLE III: Summary of model waveform accuracy require- 
ments for the LISA detector for various waveform error di- 
agnostics for measurement purposes (column three) and for 
detection purposes (column four). 



the quantities min C and min C for some of the wave- 
form accuracy requirements. From Fig.[?]we see that the 
appropriate choices for these quantities for binary black- 
hole systems with masses in the range 5 < M/Mq < 400 
for the Advanced LIGO detector are minC « 0.06 and 
minC « 0.02. Using these parameter estimates, we sum- 
marize in Table [II] our current expectations for the model 
waveform accuracy standards that will be needed for Ad- 
vanced LIGO data analysis. 

The detection requirements listed in the first two rows 
of Table [IT] should apply equally to Initial and to Ad- 
vanced LIGO, since these requirements depends only on 
the parameter emax which is determined by the proper- 
ties of the search template bank and the accepted level 
of missed detections rather than the sensitivity of the de- 
tector. The somewhat stronger sufficient conditions that 
appear in rows 3-5 of Table [IT] also depend on the con- 
stants C and C, which are larger for the Initial LIGO 
case by factors of 10 and 2 respectively because the ap- 
propriate mass range for Initial LIGO is smaller. The 
appropriate Initial LIGO requirements for measurement 
are less clear. The Initial LIGO detector is about ten 
times less sensitive than the planned Advanced LIGO 
detector, so the expectation is that the accuracy require- 
ments should be about ten times weaker than those listed 
in Table |TT| However until a detection is actually made, 
no measurement requirements will be needed at all. 

While the timetable and the technical specifications of 
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the planned LISA detector are still being developed, we 
think it is appropriate to consider here what waveform ac- 
curacy standards this mission will eventually require from 
the waveform simulation community. The maximum 
signal-to-noise ratio for supermassive binary black-hole 
observations by LISA is expected to be much larger than 
the stellar mass black- hole observations made by LIGO. 
Supermassive black-hole mergers are expected to occur 
at a rate of about one merger per year within a sphere 
that extends to cosmological redshift z = 2 [s^, HI] . The 
largest signal-to-noise ratio for non-spinning equal-mass 
binaries located at 15 Gpc (redshift z « 2) is about 
max p « 4 X 10'^ for an optimally oriented system with 
total mass 5 x 10^ [s^. Thus the requirement on the 
accuracy of model waveforms for measurement purposes 
is likely to be much more demanding for LISA than for 
LIGO. If the LISA template banks are constructed in the 
same way as the LIGO template banks, then it is appro- 
priate to assume the maximum mismatch parameter is 
fmax — 0.005 as in the LIGO case. FigureOillustrates the 
quantities C and C based on the approximate LISA noise 
curve constructed by Barack and Cutler [s^ (cf. their 
Eq. 30) using a 10~^ Hz low frequency cutoff. It follows 
that minC ~ 0.02 and minC ~ 0.004 for binary sys- 
tems with total masses in the range 10^ < M /Mq < 10^. 
Using these parameter estimates, we summarize in Ta- 
ble [ITIl our current expectations for the model waveform 
accuracy standards that will be needed for LISA data 
analysis. 

The accuracy requirements for measurement and de- 
tection that we discuss here provide upper limits on the 
allowed errors of model waveforms. These upper limits 
are the only requirements on model waveform accuracy 
when the detector is ideal, i.e. when the response func- 



tion of the detector is known with absolute precision. In 
Sec, mil we discuss the additional requirements that must 
be imposed when the response function has errors. We 
show that the model waveform error need never be de- 
creased to a level below a certain fraction, Tymin ~ 0.4, of 
the response function error. For Initial LIGO the calibra- 
tion error is small enough that it will not affect the ability 
of the instrument to make detections at all. The effect 
of this error on the ability of Initial LIGO to make mea- 
surements is more complicated: Calibration errors will 
degrade the quality of measurements made on sources 
with large signal to noise ratios, p > 80, and decreasing 
the model waveform error below Tymin times the response 
function error will not improve these measurements sub- 
stantially. For weaker signals, p < 80, the calibration 
error is likely to degrade the quality of measurements to 
some extent, but the ideal-detector model-waveform ac- 
curacy standards should nevertheless be enforced in this 
case. 
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